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(54) Conversion apparatus and conversion method 

(57) A conversion apparatus and method is dis- 
closed by which a file including data multiplexed therein 
can be edited or handled readily while maintaining the 
compatibility. A standard/independent conversion sec- 
tion converts a file of a standard AV multiplex format 
wherein video data and audio data are placed in a mul- 
tiplexed state in a body into a file of an AV independent 
format wherein video data or audio data are placed col- 
lectively in a body. Meanwhile, an independent/standard 
conversion section converts a file of the AV independent 
formation into a file of the standard AV multiplex format. 
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AV multiplex format supplied thereto from the format 
conversion section 12 through the network 4. Further, 
the communication interface 13 receives a file of the 
standard AV multiplex format transmitted thereto 
through the network 4 and supplies the file to the format 
conversion section 12. 

[0022] In the disk apparatus 1 having the configura- 
tion described above, the communication interface 13 
receives a file of the standard AV multiplex format trans- 
mitted thereto through the network 4 and supplies the 
file to the format conversion section 1 2. The format con- 
version section 12 converts the file of the standard AV 
multiplex format from the communication interface 13 
into a file of the AV independent format and supplies the 
resulting file to the disk driving section 1 1 . The disk driv- 
ing section 11 records the file of the AV independent 
multiplex format from the format conversion section 12 
onto an optical disk 7 loaded therein. 
[0023] Further, in the disk apparatus 1 , the disk driving 
section 1 1 reads out a file of the AV independent format 
from an optical disk 7 loaded therein and supplies the 
file to the format conversion section 1 2. The format con- 
version section 1 2 converts the file of the AV Independ- 
ent format from the disk driving section 11 into a file of 
the standard AV multiplex format and supplies the re- 
sulting file to the communication interface 13. The com- 
munication interface 13 transmits the file of the standard 
AV multiplex format from the format conversion section 
12 through the network 4. 

[0024] A file of the standard AV multiplex format con- 
forms to, for example, the standards of the MXF and in- 
cludes a header, a body, and a footer. Since a file of the 
standard AV multiplex format conforms to the standards 
of the MXF, the body thereof includes video data and 
audio data as AV data placed in a multiplexed state in a 
unit of, for example, one frame therein. 
[0025] Referring to FIG. 1 , AV apparatus 5 and 6 con- 
nected to the network 4 are apparatus that conform to 
the standards of the MXF and can therefore handle a 
file conforming to the standards of the MXF. Accordingly, 
each of the AV apparatus 5 and 6 can transmit a file of 
the standard AV multiplex format to the disk apparatus 
1 through the network 4. Further, each of the AV appa- 
ratus 5 and 6 can receive a file of the standard AV mul- 
tiplex format transmitted thereto from the disk apparatus 
1 . In other words, the disk apparatus 1 and the AV ap- 
paratus 5 and 6 can exchange a file of the standard AV 
multiplex format therebetween through the network 4. 
Further, each of the AV apparatus 5 and 6 can perform 
various processes such as streaming reproduction of a 
received file of the standard AV multiplex format. 
[0026] It is to be noted that an apparatus conforming 
to the existing standards of the MXF like the AV appa- 
ratus 5 and 6 is hereinafter referred to suitably as stand- 
ard apparatus. 

[0027] Meanwhile, a file of the AV independent format 
includes a header, a body, and a footer similarly as in a 
file of the standard AV multiplex format. However, the 



body has a form different from that of the body of a file 
of the standard AV multiplex format. In particular, in a 
file of the AV independent format, video data and audio 
data are placed in different files from each other. While 

s the video file, which is a file of video data, has a header 
and a footer of the same form as that of a file of the 
standard AV multiplex format, the body of the video file 
includes video data placed collectively therein. Also the 
audio file, which is a file of audio data, has a header and 

10 a footer of the form same as that of a file of the standard 
AV multiplex format. However, the body of the audio file 
has audio data placed collectively therein. 
[0028] Accordingly, if a video file or an audio file of the 
AV independent format is transmitted from the disk ap- 

'5 paratus 1 to the AV apparatus 5 or 6, the AV apparatus 
5 or 6 cannot handle video data or audio data placed in 
the body of the video file or the audio file of the AV in- 
dependent format unless the apparatus is ready for the 
AV independent format. However, the AV apparatus 5 

20 or 6 can handle the video file or the audio file itself of 
the AV independent format. In particular, the video file 
or the audio file of the AV independent format is formed 
from a header, a body, and a footer similarly as in a file 
of the standard AV multiplex format, and the head and 

25 the footer have a form same as that of a file of the stand- 
ard AV multiplex format. Therefore, unless the "con- 
tents* of the body (the data placed in the body) are re- 
ferred to, the video file or the audio file itself of the AV 
independent format is equivalent to a file of the standard 

30 AV multiplex format (that is, conforms to the standard 
AV multiplex format). Accordingly, even if the AV appa- 
ratus 5 or 6, which is a standard apparatus, is not ready 
for the AV independent format, it can handle the video 
file or the audio file itself of the AV Independent format. 

35 [0029] In other words, the disk apparatus 1 and the 
AV apparatus 5 or 6, which is a standard apparatus, can 
perform file exchange of a file of the AV independent 
format. 

[0030] As described above, a file of the AV independ- 
40 ent format is equivalent to a file of the standard AV mul- 
tiplex format unless the "contents" of the body of the file 
are referred to. From this point of view, it can be consid- 
ered that a file of the AV independent format is compat- 
ible with a file of the standard AV multiplex format. 
45 [0031 ] An optical disk 7 can be removably loaded into 
a disk apparatus 2. The disk apparatus 2 is a standard 
apparatus similarly to, for example, the AV apparatus 5 
and 6, and reads out a video file or an audio file of the 
AV independent format from an optical disk 7 loaded 
50 therein and supplies the thus read out file to an editing 
apparatus 3. 

[0032] Again, a video file or an audio file of the AV 
independent format Is equivalent to a file of the standard 
AV multiplex format unless the "contents" of the body of 
55 the file are referred to as described hereinabove. There- 
fore, the disk apparatus 2, which is a standard appara- 
tus, can read out a video file or an audio file of the AV 
Independent format from the optical disk 7. 
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[0033] The editing apparatus 3 is an apparatus that is 
ready for the AV independent format and can handle a 
tile of the AV independent format. The editing apparatus 
3 performs, for example, AV independent editing of a 
video file or an audio file of the AV independent format 
supplied thereto from the disk apparatus 2 and supplies 
a video file or an audio file of the AV independent format 
as a result of the editing to the disk apparatus 2. 
[0034] The disk apparatus 2 records a video file or an 
audio file of the AV independent format supplied thereto 
from the editing apparatus 3 onto an optical disk 7 load- 
ed therein. 

[0035] Once again, a video file or an audio file of the 
AV independent format is equivalent to a file of the 
standard AV multiplex format unless the "contents" of 
the body of the file are referred to as described herein- 
above. Therefore, the disk apparatus 2, which is a 
standard apparatus, can record a video file or an audio 
file of the AV independent format onto the optical disk 7. 
[0036] As described hereinabove, in a file of the 
standard AV multiplex format, video data and audio data 
are placed in a multiplexed state, for example, in a unit 
of a frame in the body. Meanwhile, in a video file or an 
audio file of the AV independent format, video data or 
audio data are placed collectively in the body. Therefore, 
editing such as AV independent editing of a video file or 
an audio file of the AV independent format can be per- 
formed readily. Further, since a file of the AV independ- 
ent format has a header and a footer of the same form 
as that of a file of the standard AV multiplex format, it is 
compatible with a file of the standard AV multiplex format 
unless the "contents" of the body are referred to. Con- 
sequently, a file of the AV independent format can be 
handled by a standard apparatus. 
[0037] FIG. 2 shows an example of the standard AV 
multiplex format. 

[0038] More particularly, FIG. 2 illustrates a standard 
AV multiplex format, which adopts video data coded in 
accordance with the Moving Picture Experts Group 
(MPEG) I MX method called D10 as video data placed 
in the body. Further, the standard AV multiplex format 
illustrated adopts non-compressed audio data of the Au- 
dio Engineering Society (AES) 3 form as audio data 
placed in the body. 

[0039] It is to be noted that other video data and audio 
data of various formats such as a format of the Digital 
Video (DV) standards can be placed in the body alter- 
natively. 

[0040] A file of the standard AV multiplex format is 
formed from a header (File Header), a body (File Body), 
and a footer (File Footer) placed in order from the top 
therein. 

[0041] The header includes a Header Partition Pack, 
Header Metadata and an Index Table placed in order 
from the top therein. The head partition pack includes 
data for specifying the header, the form of data placed 
in the body, information representative of a file format 
and so forth placed therein. The header metadata in- 



cludes metadata of a Hie unit placed therein. The meta- 
data includes, for example, a preparation date of the file, 
and information regarding data placed in the body. The 
index table includes a table placed therein. The table 

5 indicates the positions of edit units hereinafter de- 
scribed, which are placed in the body. 
[0042] It is to be noted that the index table is provided 
optionally and may be or may not be included in the 
header. Further, the header can place various optional 

io data therein in addition to the index table. 

[0043] Meanwhile, as the information representative 
of the file format placed in the header partition pack, in- 
formation representative of the standard AV multiplex 
format is adopted in a file of the standard AV multiplex 

w format. However, Information representative of the AV 
independent format is adopted by a file of the AV inde- 
pendent format. It is to be noted that the form itself of 
the header partition pack is common between the stand- 
ard AV multiplex format and the AV independent format. 

20 [0044] The footer is formed from a Footer Partition 
Pack in which data for specifying the footer and so forth 
are placed. 

[0045] The body is formed from more than one edit 

unit. An edit unit is a unit of a frame and includes AV 
2s data for one frame placed therein. 

[0046] in particular, an edit unit includes a system 

item, a picture item, a sound item, and an auxiliary item 

placed in order from the top therein. 

[0047] The system Item includes metadata (metadata 
30 of a frame unit) regarding a frame of video data placed 

in the succeeding picture item. The metadata of a frame 

unit may be, for example, a time code. 

[0048] The picture item includes video data for one 

frame placed therein. In FIG. 2, video data of the D10 
35 format described hereinabove are placed in the picture 

item. 

[0049] In particular, video data for one frame having 
a Key, Length, and Value (KLV) structure is planed in 
the picture item by KLV-coding. 

40 [0050] The KLV structure signifies a structure wherein 
a Key. a Length, and a Value are placed in order from 
the top. The key has a label of 1 6 bytes placed therein. 
The label conforms to the standards of the SMPTE 
298M and represents what data are placed in the value. 

45 The length has placed therein a data length of data 
placed in the Value. The value here includes video data 
of one frame placed therein. 

[0051] The picture item uses a fixed data length 
whose reference is a KLV Alignment Grid (KAG). In or- 
50 der that the picture item may have a fixed length, also 
a Filler as data for stuffing is provided with a KLV struc- 
ture similarly and placed next to the video data of the 
picture item. 

[0052] It is to be noted that the fixed length, which is 
55 a data length of the picture item and for which the KAG 
is used as a reference, is set to an integral number of 
times the sector length of the optical disk 7 such as, for 
example, 512 bytes or 2 Kbytes. In this instance, the 
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optical disk 7 and the picture item exhibit high affinity, 
and consequently, reading/writing processing from/to 
the optical disk 7 can be performed at a high speed. 
[0053] Not only the system item described above but 
also a sound item and an auxiliary item hereinafter de- 5 
scribed adopt the KLV structure similarly to the picture 
Item, and the data length is a fixed length whose refer- 
ence is the KAG. 

[0054] The sound item includes audio data placed in 
a KLV structure placed therein similarly as in the picture 
item described above. The audio data in this instance 
corresponds to one frame of the video data placed in 
the picture item. 

[0055] Further, the sound item has audio data of a plu- 
rality of channels, for example, eight channels placed in 
a multiplexed state therein. 

[0056] In particular, the Value of the KLV structure of 
the sound Item includes an element header EH, an au- 
dio sample Count ASC, a stream valid llag SVF, and 
multiplexed audio data of eight channels placed in order 
from the top therein. 

[0057] In the sound item, the audio data of eight chan- 
nels are multiplexed by placing samples of the audio da- 
ta in such an order as first samples, second samples, ... 
of the audio data of the eight channels in one frame. 
Each of numerals in parentheses of the audio data dis- 
played at the lowest portion of FIG. 2 represents what 
numbered one the sample of the audio data is. 
[0058] The element header EH has placed therein da- 
ta for specifying an element header and so forth. The 
audio sample count ASC has placed therein the number 
of samples of the audio data placed in the sound item. 
The stream valid flag SVF is formed from eight bits (one 
byte), and each bit thereof represents whether the audio 
data of the channel corresponding to the bit is valid or 
invalid. In particular, each of the bits of the stream valid 
flag SVF typically has the value of one where the audio 
data of the channel corresponding to the bit is valid, but 
has the value of zero where the audio data is invalid. 
[0059] The auxiliary item has necessary user data 
placed therein. Accordingly, the auxiliary item is an area 
into which the user can place arbitrary data. 
[0060] As described above, in the standard AV multi- 
plex format, the system item in which metadata of the 
frame unit is placed, the picture item in which video data 
is placed, the sound item in which audio data are placed, 
and the auxiliary item in which user data are placed are 
multiplexed in a unit of one frame. Further, in the sound 
item, audio data of eight channels are multiplexed in the 
unit of one sample. 

[0061] Where a file in which video data and audio data 
are placed collectively but separately is used, reproduc- 
tion of the video data and the audio data cannot be start- 
ed until after all of the file of the video data and the file 
of the audio data collected in this manner are received. 
However, where the standard AV multiplex format is 
used, since video data and audio data are multiplexed 
in a unit of a frame, if video data and audio data for one 
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frame are received, then the video data and the audio 
data of the frame can be reproduced immediately. Ac- 
cordingly, it is considered that the standard AV multiplex 
format is suitable for streaming. 

[0062] As described above, the standard AV multiplex 
format is suitable for streaming because video data and 
audio data are multiplexed in a unit of a frame. However, 
the standard AV multiplex format is not suitable for AV 
independent editing wherein video data and audio data 
are edited Independently of each other. 
[0063] Further, also metadata of a file unit exist dis- 
cretely in the system item of the edit unit. The metadata 
discrete in the system are hard to handle. 
[0064] Further, the AES3 form, which can be adopted 
by the standard AV multiplex format, Is specified such 
that at least four bytes are allocated to one sample of 
audio data. Therefore, the entire file has a great size. 
[0065] FIG. 3 illustrates an example of an AV inde- 
pendent format. 

[0066] Referring to FIG. 3, in the AV independent for- 
mat illustrated, video data, audio data, metadata in a file 
unit, and user data, which are multiplexed in the stand- 
ard AV multiplex format, are formed as files In which they 
are individually placed collectively. 
[0067] In particular, in the AV independent format, pic- 
ture items in which video data are placed in the standard 
AV multiplex format are placed collectively in the body, 
and a header and a footer having the same form as that 
of the standard AV multiplex format are added to the 
body to form a video file. 

[0068] It is to be noted that, since the body of a video 
file of the AV independent f ormat has placed therein pic- 
ture items each having a length equal to an integral 
number of times the sector length of the optical disk 7, 
also the entire body has a size equal to an integral 
number of times the sector length of the optical disk 7. 
In other words, the body of a video file of the AV inde- 
pendent format has a size, which exhibits sector align- 
ment. 

[0069] Further, while the index table shown in FIG. 2 
is shown in the header of the file of the standard AV mul- 
tiplex format, according to the MXF, the index table is 
optional. Thus, the video file shown in FIG. 3 does not 
adopt the index table. This similarly applies to audio files 
hereinafter described. 

[0070] In the AV independent format, multiplexed au- 
dio data of eight channels placed in the sound items in 
the standard AV multiplex format are demultiplexed in 
audio data for the individual channels. Thus, audio data 
whose form has been converted from the AES3 format 
into the WAVE form are placed in the KLV structure in 
the body of a file of each channel. A header and a footer 
of the form same as that of the standard AV multiplex 
format are added to the body to form an audio file. 
[0071 ] In particular, in the AV independent format, au- 
dio files for eight channels are formed independently of 
each other for audio data of the eight channels. An audio 
file for each channel is formed by processing the audio 
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data of the channel so as to have the WAVE form and 
the KLV structure, placing the processed audio data col- 
lectively into the body, and then adding a header and a 
footer of the form same as that of the standard AV mul- 
tiplex format to the body. 

[0072] It is to be noted that, while the body of an audio 
file of the AV independent format has placed therein au- 
dio data of the WAVE form of a certain channel collected 
so as to have the KLV structure as described above, the 
entire audio data may not necessarily have a size equal 
to a plural number of times the sector length of the op- 
tical disk 7. Therefore, in order to establish sector align- 
ment, a filler of the KLV structure necessary to establish 
sector alignment is placed next to the audio data of the 
KLV structure in the body of an audio file of the AV in- 
dependent format. 

[0073] The AV independent format includes the fol- 
lowing files In addition to such a video file and audio files 
individually for eight channels as described above. In 
particular, the AV independent format further includes a 
metadata file of file units in which metadata of file units 
placed in the head metadata in the standard AV multi- 
plex format are placed collectively. The AV independent 
format further includes a metadata file of frame units in 
which system items in which metadata of frame units 
are placed in the standard AV multiplex format are 
placed collectively. Furthermore, the AV independent 
format includes an auxiliary file wherein auxiliary items 
in which user data are placed in the standard AV multi- 
plex format are placed collectively. 
[0074] In addition, the AV Independent format in- 
cludes a master file in which pointers to a video file, au- 
dio files individual for eight channels, a metadata file of 
file units, a metadata file of frame units and an auxiliary 
file are described. 

[0075] More particularly, the master file is described, 
for example, in the Extensible Markup Language (XML). 
In the master file, for example, file names of a video file, 
audio files individual for eight channels, a metadata file 
of file units, a metadata file of frame units, and an aux- 
iliary file are described as pointers to the files. 
[0076] Accordingly, the video file, audio files individual 
for eight channels, metadata file of file units, metadata 
file of frame units, and auxiliary file can be referred to 
from the master file. 

[0077] It is to be noted that, for example, the auxiliary 
file may be an optional file. 

[0078] It is to be noted that the metadata file of file 
units, metadata file of frame units and the auxiliary file 
illustrated in FIG. 3 do not have a header and a footer 
of the form same as that of the standard AV multiplex 
format. However, a header and a footer of the form same 
as that of the standard AV multiplex format may other- 
wise be added to the metadata file of file units, metadata 
file of frame units, and the auxiliary file. 
[0079] Further, the header metadata, which forms the 
header of a video file and a header file of the AV inde- 
pendent format, has metadata of file units of a minimum 
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set placed therein. 

[0080] In particular, the AV independent format in- 
cludes metadata files of file units wherein metadata of 
file units placed in the header metadata are placed in 

5 the standard AV multiplex format. Therefore, it is redun- 
dant to place the metadata of file units placed in the 
metadata files In an overlapping relationship with the 
header metadata, which form the header of the video 
file and audio files. Further, this makes the size of the 

to entire file of the AV Independent format great. 

[0081] However, in the MXF, the header metadata is 
an item essentially required for the header, and if a 
header is formed without placing header metadata 
therein, then the resulting header does not have the 

15 same form as that of the standard AV multiplex format. 
[0082] Meanwhile, in the MXF, metadata of file units 
to be placed in the header metadata includes various 
Items. However, some of the items are essentially re- 
quired, but the other items are optional. 

20 [0083] Therefore, in order to prevent the file size from 
becoming great and maintain the compatibility with the 
standard AV multiplex format, the header metadata, 
which form the header of the video file and the audio 
files of the AV independent format, has metadata of file 

25 units of a minimum set placed therein. More particularly, 
metadata only of those items whose placement in the 
header metadata is essentially required in the MXF are 
placed in the header metadata of the video file and the 
audio files of the AV independent format. 

30 [0084] As described above, in the AV independent for- 
mat, video data are placed collectively In the video file, 
and audio data of individual channels are collectively 
placed in the audio files for the individual channels. 
Therefore editing such as AV independent editing 

35 wherein video data and audio data are edited independ- 
ently of each other can be performed readily. 
[0085] Furthermore, in the AV independent format, 
since audio data have the WAVE format, the data 
amount can be reduced when compared with an alter- 

40 native case wherein audio data of the AES3 form are 
adopted as in the standard AV independent format. As 
a result, when a file of the AV independent format is re- 
corded onto a storage such as the optical disk 7, the 
capacity of the storage necessary for the recording can 

<5 be reduced when compared with an alternative case 
wherein a file of the standard AV multiplex format is re- 
corded. 

[0086] Further, a video file and audio files of the AV 
independent format include a header, a body, and a 

50 footer disposed in order from the top similarly to a file of 
the standard AV multiplex format, and the header and 
the footer are placed in a form same as that of the stand- 
ard AV multiplex form. Therefore, if a video file and audio 
files of the AV independent format are recorded onto a 

55 removable optical disk 7 by the disk apparatus 1 and the 
optical disk 7 is loaded into the disk apparatus 2, then 
if the disk apparatus 2 is a standard apparatus (on which 
a file of the MXF can be handled), then the apparatus 2 
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can read out the video file and the audio files of the AV 
independent format from the optical disk 7. 
[0087] Further, in the AV independent format, meta- 
data of file units and metadata of frame units are collect- 
ed separately each into different files. This facilitates a 5 
search process in which metadata is used. 
[0088] FIG. 4 shows an example of a configuration of 
the f ormat conversion section 1 2 of the disk apparatus 
1 of FIG. 1 . 

[0089] Referring to FIG. 4, the format conversion sec- 
tion 12 shown includes a standard/independent conver- 
sion section 21 and an independent/standard conver- 
sion section 22. 

[0090] The standard/independent conversion section 
21 converts a file of the standard AV multiplex format of 
FIG. 2 supplied thereto from the communication inter- 
face 13 into a file of the AV independent format of FIG. 
3 and supplies the resulting file to the disk driving section 
11. The independent/standard conversion section 22 
converts a file of the AV independent format of FIG. 3 
supplied thereto from the disk driving section 11 into a 
file of the standard AV multiplex format of FIG. 2 and 
supplies the resulting file to the communication interface 
13. 

[0091] FIG. 5 shows an example of a configuration of 
the standard/independent conversion section 21 shown 
in FIG. 4. 

[0092] Referring to FIG. 5, a file of the standard AV 
multiplex format is supplied from the communication in- 
terface 13 to a buffer 31. The buffer 31 temporarily 
stores the file of the standard AV multiplex format sup- 
plied thereto. 

[0093] After the file of the standard AV multiplex for- 
mat is stored into the buffer 31 , a master file preparation 
section 32 prepares a master file of the AV independent 
format from the file of the standard AV multiplex format 
and supplies the prepared file to a buffer 44. 
[0094] A header acquisition section 33 extracts a 
header from the file of the standard AV multiplex format 
stored in the buffer 31 to acquire the header and sup- 
plies the header to a header metadata extraction section 
35. 

[0095] A body acquisition section 34 extracts a body 
from the file of the standard AV multiplex format stored 
in the buffer 31 to acquire the body and supplies the 
body to a system item extraction section 36, an auxiliary 
item extraction section 38, a picture item extraction sec- 
tion 40, and a sound item extraction section 42. 
[0096] The header metadata extraction section 35 ex- 
tracts header metadata from the header supplied there- 
to from the header acquisition section 33 and supplies 
metadata of file units placed in the header metadata to 
a metadata file preparation section 37. The system item 
extraction section 36 extracts system items in which the 
metadata of frames are placed from edit units of the 
body supplied thereto from the body acquisition section 
34 and supplies the system items to the metadata file 
preparation section 37. The metadata file preparation 
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section 37 prepares a metadata file of file units in which 
the metadata of file units supplied thereto from the head- 
er metadata extraction section 35 are placed. The meta- 
data file preparation section 37 further prepares a meta- 
data file of frame units in which the system items of the 
edit units supplied thereto from the system item extrac- 
tion section 36 are collectively and sequentially placed. 
The metadata file preparation section 37 supplies the 
metadata files of file units and frame units to the buffer 
44. 

[0097] The auxiliary item extraction section 38 ex- 
tracts auxiliary items in which user data of frame units 
are placed from the edit units of the body supplied there- 
to from the body acquisition section 34 and supplies the 
extracted auxiliary Items to an auxiliary file preparation 
section 39. The auxiliary file preparation section 39 pre- 
pares an auxiliary file in which the auxiliary items of the 
edit units supplied thereto from the auxiliary file prepa- 
ration section 39 are collectively placed and supplies the 
auxiliary file to the buffer 44. 

[0098] The picture item extraction section 40 extracts 
picture items in which video data of frame units are 
placed from the edit units of the body supplied thereto 
from the body acquisition section 34 and supplies the 
picture items to a video file preparation section 41 . The 
video file preparation section 41 prepares a file in which 
the picture items of the edit units supplied thereto from 
the picture item extraction section 40 are placed collec- 
tively in the body and a header and a footer of a form 
same as that of a file of the standard AV multiplex format 
are added to the body. The video file preparation section 
41 supplies the thus prepared file to the buffer 44. 
[0099] The sound item extraction section 42 extracts 
sound items in which audio data of frame units are 
placed from the edit units of the body supplied thereto 
from the body acquisition section 34 and supplies the 
sound item to an audio file preparation section 43. The 
audio file preparation section 43 prepares an audio file 
for each channel in which audio data of the channel 
placed in the sound items of the edit units supplied 
thereto from the sound item extraction section 42 are 
placed collectively for the channel in the body and a 
header and a footer of a form same as that of a file of 
the standard AV multiplex format are added to the body. 
The audio file preparation section 43 supplies the audio 
files for the channels prepared in this mannerto the buff- 
er 44. 

[01 00] The buffer 44 temporarily stores the master file 
supplied thereto from the master file preparation section 
32, the metadata files of file units and frame units sup- 
plied thereto from the metadata file preparation section 
37, and the auxiliary file supplied thereto from the aux- 
iliary file preparation section 39. Further, the buffer 44 
temporarily stores the video file supplied thereto from 
the video file preparation section 41 and the audio files 
for the channels supplied thereto from the audio file 
preparation section 43. Then, the buffer 44 supplies the 
stored files as files of the AV independent format to the 
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disk driving section 11. 

[0101) FIG. 6 shows an example of a configuration of 
the video file preparation section 41 shown in FIG. 5. 

[01 02) Referring to FIG. 6, a picture item of each edit 
unit supplied from the picture item extraction section 40 
is received by a coupling section 51 . The coupling sec- 
tion 51 successively couples or connects picture Items 
of edit units successively supplied thereto and supplies 
the picture items to a header/footer addition section 52. 
The header/footer addition section 52 adds a header 
and a footer of a form same as that of a Tile of the stand- 
ard AV multiplex format to a body provided by the picture 
items of the edit units coupled to each other and sup- 
plied thereto from the coupling section 51 to form a video 
file of the AV independent format. Then, the header/ 
footer addition section 52 outputs the video file of the 
AV independent format 

[0103] FIG. 7 shows an example of a configuration of 
the audio file preparation section 43 shown in FIG. 5. 
[0104] Referring to FIG. 7, a sound item of each edit 
unit supplied from the sound item extraction section 42 
is received by a KLV decoder 61 . The KLV decoder 61 
decomposes the KLV structure of audio data placed in 
the sound items of the edit units to obtain multiplexed 
audio data of eight channels (such data is hereinafter 
referred to suitably as multiplexed audio data) and sup- 
plies the multiplexed audio data to a channel demulti- 
plexing section 62. 

[0105] The channel demultiplexing section .62 demul- 
tiplexes the multiplexed audio data of sound items sup- 
plied thereto from the KLV decoder 61 into audio data 
of individual channels and supplies the audio data of the 
channels collectively for the individual channels to a da- 
ta conversion section 63. 

[0106] The data conversion section 63 converts the 
coding method of the audio data of the channels sup- 
plied thereto from the channel demultiplexing section 
62. In particular, while audio data in the standard AV 
multiplex format are in a form encoded by the AES3 
form, the audio data in the AV independent format are 
in another form encoded by the WAVE system. There- 
fore, the data conversion section 63 converts the audio 
data (audio data of the AES3 form) encoded by the 
AES3 method into audio data (audio data of the WAVE 
system) encoded by the WAVE system. 
[01 07] It is to be noted that, while the data conversion 
section 63 here converts audio data of the AES3 system 
into audio data of the WAVE system, the section 63 can 
convert the audio data into audio data of a system other 
than the WAVE system. In particular, the conversion of 
audio data by the data conversion section 63 is per- 
formed for the object of suppressing the data amount of 
audio data of the AES3 system. Therefore, the data con- 
version section 63 may adopt any coding system only if 
the coding system can achieve the object just described. 
[0108] On the other hand, where the data amount of 
audio data does not matter, the audio file preparation 
section 43 can be configured without provision of the 



data conversion section 63. 

[01 09) The audio data of the individual channels of the 
WAVE system obtained by the data conversion section 
63 are supplied to a KLV encoder 64. The KLV encoder 

5 64 KLV-encodes the audio data supplied thereto from 
the data conversion section 63 and collected for the in- 
dividual channels into audio data of the KLV structure. 
Then, the KLV encoder 64 adds a filler (FIG. 3) neces- 
sary for establishment of sector alignment to the audio 

io data of each channel of the KLV structure and supplies 
the resulting audio data of the channels to a header/ 
footer addition section 65. 

[0110] The header/footer addition section 65 adds a 
header and a footer of a form same as that of a file of 

is the standard AV multiplex format to the body of each 
channel, which includes the audio data of the channel 
supplied thereto from the KLV encoder 64, to produce 
an audio file for each channel of the AV independent 
format. Then, the header/footer addition section 65 out- 

20 puts the audio files of the individual channels of the AV 
independent format. 

[0111] Referring back to FIG. 5, the standard/inde- 
pendent conversion section 21 performs a master file 
preparation process for preparing a master file as a file 

25 of the AV independent format, a metadata file prepara- 
tion process for preparing metadata files of file units and 
frame units, and an auxiliary file preparation process for 
preparing an auxiliary file. The standard/independent 
conversion section 21 further performs a video file prep- 

30 aration process for preparing a video file and an audio 
file preparation process for preparing audio files. 
[0112] Thus, the master file preparation process, 
metadata file preparation process, auxiliary file prepa- 
ration process, video file preparation process, and audio 

35 file preparation process executed by the standard/inde- 
pendent conversion section 21 are described below with 
reference to flow charts of FIGS. 8 to 13. 
[01 13) First, the master file preparation process is de- 
scribed with reference to the flow chart of FIG. 8. 

40 [0114] The master file preparation is started, for ex- 
ample, when a file of the standard AV multiplex format 
is supplied to and stored into the buffer 31 (FIG. 5). 
Thus, first at step S1 , the master file preparation section 
32 (FIG. 5) produces file names for metadata files of file 

is units and frame units, an auxiliary file, a video file, and 
audio files for individual channels. Then, the processing 
advances to step S2. At step S2, the master file prepa- 
ration section 32 prepares a master file in which a link 
to a file of each of the file names produced at step S1 is 

so described in the XML and supplies the master file to the 
buffer 44 so that the master file is stored into the buffer 
44. The master file preparation process is ended there- 
by. 

[0115] Now, the metadata file preparation process for 
55 file units for preparing a metadata file of file units is de- 
scribed with reference to the flow chart of FIG. 9. 
[01 1 6] For example, if a file of the standard AV multi- 
plex format is supplied to and stored into the buffer 31 
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(FIG. 5), then the metadata file preparation process for 
file units is started. First at step S11 , the header acqui- 
sition section 33 acquires the header from the file of the 
standard AV format stored in the buffer 31 and supplies 
the header to the header metadata extraction section 
35. Then, the processing advances to step S12. At step 
S1 2, the header metadata extraction section 35 extracts 
header metadata from the header supplied thereto from 
the header acquisition section 33 and supplies the head- 
er metadata of file units placed in the header metadata 
to the metadata file preparation section 37. Then, the 
processing advances to step S13. At step S13, the 
metadata file preparation section 37 prepares a meta- 
data file of file units in which the metadata of file units 
supplied thereto from the header metadata extraction 
section 35 are placed, and supplies the metadata file of 
file units to the buffer 44 so that the metadata file of file 
units may be stored into the buffer 44. The metadata 
preparation process for file units is ended thereby. 
[0117] Now, the metadata file preparation process for 
frame units wherein a metadata file of frame units is pre- 
pared is described with reference to the flow chart of 
FIG. 10. 

[01 18] For example, if a file of the standard AV multi- 
plex format is stored into the buffer 31 (FIG. 5), then the 
metadata file preparation process for frame units is 
started. First at step S21 , the body acquisition section 
34 acquires the body from the file of the standard AV 
multiplex format stored in the buffer 31 and supplies the 
body to the system item extraction section 36. Then, the 
processing advances to step S22. At step S22, the sys- 
tem item extraction section 36 extracts system items in 
which metadata of frame units are placed from edit units 
of the body supplied thereto from the body acquisition 
section 34 and supplies the system items to the meta- 
data file preparation section 37. Then, the processing 
advances to step S23. At step S23, the metadata file 
preparation section 37 couples the system items of the 
edit units supplied from the system item extraction sec- 
tion 36 to prepare a metadata file of frame units in which 
the system items of the edit units are collectively placed. 
Then, the metadata file preparation section 37 supplies 
the metadata file of frame units to the buffer 44 so that 
the metadata file of frame units is stored into the buffer 
44. The metadata file preparation process for a frame 
unit is ended thereby. 

[0119] Subsequently, the auxiliary file preparation 
process for preparing an auxiliary file is described with 
reference to the flow chart of FIG. 11 . 
[0120] For example, if a file of the standard AV multi- 
plex format is supplied to the buffer 31 (FIG. 5), then the 
auxiliary file preparation process is stared. First at step 
S31 , the body acquisition section 34 acquires the body 
from the file of the standard AV multiplex format stored 
in the buffer 31 and supplies the body to the auxiliary 
item extraction section 38. Then, the processing ad- 
vances to step S32. At step S32, the auxiliary item ex- 
traction section 38 extracts auxiliary items from edit 



18 

units of the body supplied thereto from the body acqui- 
sition section 34 and supplies the extracted auxiliary 
items to the auxiliary file preparation section 39. Then, 
the processing advances to step S33. At step S33, the 

5 auxiliary file preparation section 39 couples the auxiliary 
items of the edit units supplied thereto from the auxiliary 
Item extraction section 38 to prepare an auxiliary file in 
which the auxiliary items of the edit units are placed col- 
lectively. Then, the auxiliary file preparation section 39 

w supplies the auxiliary file to the buffer 44 so that the aux- 
iliary file is stored into the buffer 44. The auxiliary file 
preparation process is ended thereby. 
[01 21 ] Now, the video file preparation process for pre- 
paring a video file is described with reference to the flow 

'5 chart of FIG. 12. 

[0122] For example, if a file of the standard AV multi- 
plex format is supplied to and stored into the buffer 31 
(FIG. 5), then the video file preparation process Is start- 
ed. First at step S41 , the body acquisition section 34 

20 acquires the body from the file of the standard AV mul- 
tiplex format stored in the buffer 31 and supplies the 
body to the picture item extraction section 40. Then, the 
processing advances to step S42. At step S42, the pic- 
ture item extraction section 40 extracts picture items 

25 from edit units of the body supplied thereto from the 
body acquisition section 34 and supplies the extracted 
picture items to the video file preparation section 41 . 
Then, the processing advances to step S43. At step 
S43, the video file preparation section 41 (FIG. 6) cou- 

30 pies the picture items of the edit units supplied thereto 
from the picture item extraction section 40 to produce a 
body in which the picture items of the edit units are col- 
lectively placed and supplies the produced body to the 
header/footer addition section 52. Then, the processing 

35 advances to step S44. 

[01 23] At step S44, the header/footer addition section 
52 adds a header and a footer of a form same as that 
of the file of the standard AV multiplex format to the body 
supplied thereto from the coupling section 51 to prepare 
a video file of the AV independent format. Then, the 
header/footer addition section 52 supplies the video file 
of the AV independent format to the buffer 44 so that the 
video file is stored into the buffer 44. The video file prep- 
aration process is ended thereby. 

45 [01 24] Now, the audio file preparation process for pre- 
paring audio files is described with reference to the flow 
chart of FIG. 13. 

[0125] For example, if a file of the standard AV multi- 
plex format is supplied to and stored into the buffer 31 

50 (FIG. 5), then the audio file preparation process Is start- 
ed. First at step S51 , the body acquisition section 34 
acquires the body from the file of the standard AV mul- 
tiplex format stored in the buffer 31 and supplies the 
body to the sound item extraction section 42. Then, the 

55 processing advances to step S52. At step S52, the 
sound item extraction section 42 extracts sound items 
from edit units of the body supplied thereto from the 
body acquisition section 34 and supplies the extracted 



EP1 427 217 A1 



10 




sound items to the audio file preparation section 43. 
Then, the processing advances to step S53. At step 
S53, the audio file preparation section 43 (FIG. 7) de- 
composes the KLV structure of the audio data placed in 
the sound items of the edit units to obtain multiplexed 
audio data of eight channels. Then, the audio file prep- 
aration section 43 supplies the multiplexed audio data 
to the channel demultiplexing section 62. Thereafter, the 
processing advances to step S54. 
[0126] At step S64, the channel demultiplexing sec- 
tion 62 demultiplexes the multiplexed audio data of the 
sound items supplied thereto from the KLV decoder 61 
to form audio data of the AES3 form for the individual 
channels. Then, the channel demultiplexing section 62 
collectively places the audio data of the AES3 form for 
the individual channels and supplies the resulting audio 
data to the data conversion section 63. 
[0127] Then, the processing advances to step S55, at 
which the data conversion section 63 converts the audio 
data of the AES3 of the individual channels supplied 
thereto from the channel demultiplexing section 62 into 
audio data of the WAVE form and supplies the audio da- 
ta of the WAVE form to the KLV encoder 64. Then, the 
processing advances to step S56. At step S56, the KLV 
encoder 64 KLV-encodes the audio data of the WAVE 
form collected for the individual channels and received 
from the data conversion section 63 into audio data of 
the KLV structure. Further, the KLV encoder 64 adds a 
filler (FIG. 23) necessary to establish sector alignment 
to the audio data of each of the channels having the KLV 
structure. Consequently, the KLV encoder 64 produces 
a body for each channel in which the audio data of the 
WAVE form of the channel are placed collectively, and 
besides a required filler Is placed. The KLV encoder 64 
supplies the thus produced bodies to the header/footer 
addition section 65. Thereafter, the processing advanc- 
es to step S57. 

[0128] At step S57, the header/footer addition section 
65 adds a header and a footer of a form same as that 
of the file of the standard AV multiplex format to the body 
of each of the channels supplied thereto from the KLV 
encoder 64 to prepare an audio file of the AV independ- 
ent format for the channel. Then, the header/footer ad- 
dition section 65 supplies the audio files of the AV inde- 
pendent format for the individual channels to the buffer 
44 so that the audio files are stored into the buffer 44. 
The audio file preparation process is ended thereby. 
[0129] FIG. 14 shows an example of a configuration 
of the independent/standard conversion section 22 of 
FIG. 4. 

[0130] Referring to FIG. 14, a buffer 101 temporarily 
stores files of the AV independent format supplied there- 
to from the disk driving section 11 (FIG. 1). The files in- 
clude a master file, a metadata file of file units, a meta- 
data file of frame units, an auxiliary file, a video file, and 
audio files for eight channels. 

[0131] A file acquisition section 1 02 refers to the mas- 
ter file stored in the buffer 101 to recognize the file 



names of the metadata file of file units, metadata file of 
frame units, auxiliary file, video file, and audio files for 
eight channels. Then, the buffer 101 accesses the disk 
driving section 11 through the buffer 1 01 to read out the 

5 metadata file of file units, metadata file of frame units, 
auxiliary file, video file, and audio files for eight channels 
from the optical disk 7 based on the recognized file 
names to acquire the files. Then, the file acquisition sec- 
tion 102 supplies the metadata file of file units and the 

10 metadata file of frame units thus acquired to a metadata 
file processing section 103. Further, the file acquisition 
section 102 supplies the auxiliary file to an auxiliary file 
processing section 1 04, supplies the video file to a video 
file processing section 105, and supplies the audio files 

i* for eight channels to an audio file processing section 
106. 

[0132] The metadata file processing section 103 ex- 
tracts metadata of file units from within the metadata file 
of file units supplied thereto from the file acquisition sec- 

20 tion 102. Further, the metadata file processing section 
103 extracts system items in which the metadata of 
frame units are placed from within the metadata file of 
frame units. Then, the metadata file processing section 
103 supplies the metadata of file units and the system 

25 items to a data synthesis section 107. 

[01331 The auxiliary file processing section 104 ex- 
tracts auxiliary items from within the auxiliary file sup- 
plied thereto from the file acquisition section 102 and 
supplies the auxiliary Items to the data synthesis section 

so 107. 

[01 34] The video tile processing section 1 05 extracts 
picture items from within the video file supplied thereto 
from the file acquisition section 1 02 and supplies the pic- 
ture items to the data synthesis section 107. 

35 [01 35] The video file processing section 1 05 extracts 
audio data of the individual channels from within the au- 
dio files of the eight channels supplied thereto from the 
file acquisition section 102 and produces sound items 
in which the audio data of the individual channels are 

40 placed in a multiplexed state. The video file processing 
section 105 supplies the sound items to the data syn- 
thesis section 1 07. 

[0136] The data synthesis section 107 receives the 
metadata of file units and the system items supplied 

45 thereto from the metadata file processing section 103, 
the auxiliary items supplied thereto from the auxiliary file 
processing section 104, the picture items supplied 
thereto from the video file processing section 105, and 
the sound items supplied thereto from the audio file 

so processing section 1 06. Then, the data synthesis sec- 
tion 107 uses the received items to prepare a file of the 
standard AV multiplex format and supplies the file of the 
standard AV multiplex format to a buffer 108. 
[01 37] The buffer 1 08 temporarily stores the file of the 

55 standard AV multiplex format supplied thereto from the 
data synthesis section 107 and supplies the file to the 
communication interface 13 (FIG. 1). 
[0138] FIG. 15 shows an example of a configuration 
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of the video file processing section 106 shown in FIG. 
14. 

[0139] A video file supplied from the file acquisition 
section 102 is received by a header/footer removal sec- 
tion 111. The header/footer removal section 111 re- 
moves a header and a footer from the video file received 
thereby and supplies the remaining body to a decompo- 
sition section 112. The decomposition section 112 sep- 
arates a sequence of picture items placed in the body 
supplied thereto from the header/footer removal section 
111 and extracts, from within the sequence, units to be 
multiplexed with other items (system items, sound 
items, and auxiliary items), that is, the individual items 
in which video data of frame units are placed. Then, the 
decomposition section 112 supplies the picture items to 
the data synthesis section 107 (FIG. 4). 
[0140] FIG. 16 shows an example of a configuration 
of the audio file processing section 106 shown in FIG. 
14. 

[0141] Audio files of eight channels supplied from the 
file acquisition section 102 are received by a header/ 
footer removal section 121 . The header/footer removal 
section 121 removes a header and a footer from each 
of the audio files of eight channels received thereby and 
supplies the remaining bodies of the channels to a KLV 
decoder 122. 

[0142] The KLV decoder 122 decomposes the KLV 
structure of the bodies of the channels supplied thereto 
from the header/footer removal section 121 and sup- 
plies the audio data of the WAVE form of the channels 
obtained by the decomposition to a data conversion sec- 
tion 123. 

[0143] The data conversion section 123 performs in- 
verse conversion to that executed by the data conver- 
sion section 63 of FIG. 7 for the audio data supplied 
thereto from the KLV decoder 1 22. In particular, the data 
conversion section 123 converts the audio data of the 
channels of the WAVE form supplied thereto from the 
KLV decoder 122 into audio data of the channels of the 
AES3 form and supplies the audio data of the channels 
of the AES3 form to a channel multiplexing section 124. 
[0144] The channel multiplexing section 124 multi- 
plexes the audio data of the channels supplied thereto 
from the channel multiplexing section 124 in a unit of a 
sample and supplies multiplexed audio data obtained 
by the multiplexing to a KLV encoder 125. 
[01 45] The KLV encoder 1 25 delimits the multiplexed 
audio data supplied thereto from the channel multiplex- 
ing section 1 24 in a u nit corresponding to each frame of 
the video data and KLV-encodes the multiplexed audio 
data corresponding to each frame so as to have a KLV 
structure. Further, the KLV encoder 1 25 adds, to the KLV 
structure of the multiplexed audio data corresponding to 
each frame, a KLV structure of a filler of a length corre- 
sponding to a shortage from the data length of a sound 
item, which is a fixed length, thereby to form a sound 
item. Then, the KLV encoder 125 supplies the thus 
formed sound Item to the data synthesis section 107 



(FIG. 14). 

[0146] FIG. 17 shows an example of a configuration 
of the data synthesis section 107 shown in FIG. 14. 
[0147] A header/footer production section 131 re- 

s ceives metadata of file units outputted from the metada- 
ta file processing section 103. The header/footer pro- 
duction section 131 produces a header and a footer of 
a file of the standard AV multiplex format and places the 
metadata of file units from the metadata file processing 

10 section 103 into the header metadata of the header 
Then, the header/footer production section 131 supplies 
the header and the footer to a header/footer addition 
section 133. 

[0148] A multiplexing section 132 receives system 

is Items outputted from the metadata file processing sec- 
tion 1 03, auxiliary items outputted from the auxiliary file 
processing section 1 04, picture items outputted from the 
video file processing section 105, and sound items out- 
putted from the audio file processing section 106. The 

20 multiplexing section 132 successively multiplexes the 
system items, picture items, sound items, and auxiliary 
items supplied thereto in this order to form a sequence 
of edit units. Then, the multiplexing section 1 32 supplies 
the sequence of edit units as a body to the header/footer 

25 addition section 133. 

[0149] The header/footer addition section 133 adds 
the header and the footer supplied thereto from the 
header/footer production section 131 to the body sup- 
plied thereto from the multiplexing section 132 to form 

30 a file of the standard AV multiplex format. As a result, 
the section 133 outputs the file of the standard AV mul- 
tiplex format. 

[0150] Referring back to FIG. 14, the independent/ 
standard conversion section 22 performs a metadata file 

35 process for processing a metadata file, an auxiliary file 
process for processing an auxiliary file, a video file proc- 
ess for processing a video file, and an audio file process 
for processing audio files. The independent/standard 
conversion section 22 further performs a synthesis proc- 

40 ess for preparing a file of the standard AV multiplex for- 
mat through synthesis using results of the processes 
mentioned above. 

[0151] The metadata file process, auxiliary file proc- 
ess, video file process, audio file process, and synthesis 

43 process performed by the independent/standard con- 
version section 22 are described below with reference 
to flow charts of FIGS. 1 8 to 22. 
[0152] First, the metadata file process is described 
with reference to the flow chart of FIG. 18. 

so [01 53] The metadata file process is started, for exam- 
ple : when a master file is read out from an optical disk 
7 by the disk driving section 11 and stored into the buffer 
101. 

[01 54] First, at step S1 01 , the file acquisition section 
55 102 refers to the master file stored in the buffer 101 to 
recognize the file names of the metadata files of file units 
and frame units. Further, at step SI 01 1 . the file acquisi- 
tion section 102 accesses the disk driving section 11 to 
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read out the metadata files of file units and frame units 
from the optical disk 7 based on the file names through 
the buffer 101 to acquire the files. Then, the file acqui- 
sition section 102 supplies the acquired metadata files 
to the metadata file processing section 103. Then, the 
processing advances to step S102. At step S102, the 
metadata file processing section 103 extracts, from 
within the metadata file of the file units supplied thereto 
from the file acquisition section 1 02, the metadata of file 
units. Further, the metadata file processing section 1 03 
extracts, from within the metadata file of the frame units, 
system items in which the metadata of the frame units 
are placed. Then, the metadata file processing section 
1 03 supplies the extracted metadata of file units and the 
system Items to the data synthesis section 107. The 
metadata file process is ended thereby. 
[01 55] Now, the auxiliary file process is described with 
reference to the flow chart of FIG. 19. 
[0156] The auxiliary file process is started, for exam- 
ple, when a master file is read out from an optical disk 
7 by the disk driving section 1 1 and stored into the buffer 
101. 

[0157] First at step S111, the file acquisition section 
102 refers to the master file stored in the buffer 101 to 
recognize the file name of the auxiliary file. Further, at 
step S111 , the file acquisition section 102 accesses the 
disk driving section 11 to read out the auxiliary file from 
the optical disk 7 based on the file name through the 
buffer 101 to acquire the auxiliary file and supplies the 
acquired auxiliary file to the auxiliary file processing sec- 
tion 104. Then, the processing advances to step S112. 
[01 58] At step S1 1 2, the auxiliary file processing sec- 
tion 1 04 decomposes the auxiliary file supplied thereto 
from the file acquisition section 102 Into auxiliary items 
to extract or acquire auxiliary items from the auxiliary 
file. The section 104 supplies the auxiliary items to the 
data synthesis section 107. The auxiliary file process is 
ended thereby. 

[0159] Now, the video file process is described with 
reference to the flow chart of FIG. 20. 
[0160] The video file is started, for example, when a 
master file Is read out from an optical disk 7 by the disk 
driving section 11 and stored into the buffer 101 . 
[0161] First at step S121 , the file acquisition section 
102 refers to the master file stored In the buffer 101 to 
recognize the file name of the video file. Further, at step 
S121 , the file acquisition section 102 accesses the disk 
driving section 11 to read out the video file from the op- 
tical disk 7 based on the file name through the buffer 
101 to acquire the video file and supplies the video file 
to the video file processing section 105. Then, the 
processing advances to step S122. 
[0162] At step S122, the header/footer removal sec- 
tion 111 o1 the video file processing section 105 (FIG. 
15) removes a header and a footer from the video file 
supplied thereto from the file acquisition section 1 02 and 
supplies the body remaining as a result of the removal 
to the decomposition section 112. Then, the processing 



advances to step S123. At step S123, the decomposi- 
tion section 112 decomposes a sequence of picture 
items placed in the body supplied thereto from the head- 
er/footer removal section 111 into individual picture 

5 items and supplies the picture items to the data synthe- 
sis section 1 07. The video file process is ended thereby. 
[0163] Now, the audio file process is described with 
reference to the flow chart of FIG. 21 . 
[01 64] The audio file process is started, for example, 

10 when a master file is read out from an optical disk 7 by 
the disk driving section 1 1 and stored into the buffer 101. 
[0165] First at step S131 , the file acquisition section 
102 refers to the master file stored in the buffer 101 to 
recognize the file names of audio files of eight channels. 

is Further, at step S131, the file acquisition section 102 
accesses the disk driving section 1 1 to read out the au- 
dio files of eight channels from the optical disk 7 based 
on the file names through the buffer 101 to acquire the 
audio files of eight channels. Then, the file acquisition 

20 section 1 02 supplies the audio files of eight channels to 
the audio file processing section 106. Thereafter, the 
processing advances to step S132. 
[0166] At step S132, the header/footer removal sec- 
tion 121 of the audio file processing section 106 (FIG. 

25 1 6) removes a header and a footer from each of the au- 
dio files of eight channels supplied thereto from the file 
acquisition section 102 and supplies the bodies of the 
channels remaining as a result of the removal to the KLV 
decoder 122. Then, the processing advances to step 

30 S133. At step SI 33, the KLV decoder 122 decomposes 
the KLV structure of the bodies of the channels supplied 
thereto from the header/hooter removal section 1 21 and 
supplies the audio data of the WAVE form of the chan- 
nels obtained by the decomposition to the data conver- 
ts sion section 1 23. Then, the processing advances to step 
S134. 

[0167] At step S134, the data conversion section 123 
converts the audio data of the channels of the WAVE 
form supplied thereto from the KLV decoder 1 22 into au- 

40 dio data of the channels of the AES3 form and supplies 
the audio data of the channels of the AES3 form to the 
channel multiplexing section 124. Then, the processing 
advances to step S135. At step S135, the channel mul- 
tiplexing section 124 multiplexes the audio data of the 

45 channels supplied thereto from the channel multiplexing 
section 1 24 and supplies the multiplexed audio data ob- 
tained by the multiplexing to the KLV encoder 1 25. Then, 
the processing advances to step S136. 
[0168] At step S136, the KLV encoder 125 delimits the 

so multiplexed audio data supplied thereto from the chan- 
nel multiplexing section 124 into units corresponding to 
frames of the video data and KLV-encodes the multi- 
plexed audio data corresponding to the frames into mul- 
tiplexed audio data of the KLV structure. Then, the 

55 processing advances to step S137. At step S137, the 
KLV encoder 125 adds a necessary KLV structure of a 
filler to the KLV structure of the multiplexed audio data 
corresponding to each of the frames to produce a sound 
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item. Then, the KLV encoder 125 supplies the sound 
Items produced in this mannerto the data synthesis sec- 
tion 1 07. The audio file process is ended thereby. 
[01 69] Now. the synthesis process is described with 
reference to the flow chart of FIG. 22. 
[01 70] The synthesis process is started, for example, 
when required items are supplied to the data synthesis 
section 107. The required items are metadata of file 
units and system items from the metadata file process- 
ing section 103, auxiliary Items from the auxiliary file 
processing section 1 04, picture items from the video file 
processing section 1 05, and sound items from the audio 
file processing section 106. 

[0171] First at step S141 s the header/footer produc- 
tion section 131 of the data synthesis section 1 07 (FIG. 
1 7) produces a header and a footer of a file of the stand- 
ard AV multiplex format and places the metadata of file 
units from the metadata file processing section 1 03 into 
the header metadata of the header. Further, at step 
S1 41 , the header/footer production section 131 supplies 
the header and the footer obtained in such a manner as 
described above to the header/footer addition section 
1 33. Thereafter, the processing advances to step S1 42. 
[0172] At step S1 42, the multiplexing section 132 mul- 
tiplexes the system items outputted from the metadata 
file processing section 1 03, the auxiliary items outputted 
from the auxiliary file processing section 1 04, the picture 
items outputted from the video file processing section 
105, and the sound items outputted from the audio file 
processing section 106. Then, the multiplexing section 
132 supplies a sequence of edit units obtained by the 
multiplexing as a body to the header/footer addition sec- 
tion 133. Then, the processing advances to step S143. 
[0173] At step S143, the header/footer addition sec- 
tion 133 adds the header and the footer supplied thereto 
from the header/footer production section 131 to the 
body supplied thereto from the multiplexing section 1 32 
to form a file of the standard AV multiplex format and 
outputs the file of the standard AV multiplex format. The 
synthesis process is ended thereby. 
[01 74] While the series of processes described above 
can be executed by hardware, it may otherwise be ex- 
ecuted by software. Where the series of processes is 
executed by software . a program, which constructs the 
software, is Installed into a computer for universal use 
or a like apparatus. 

[0175] FIG. 23 shows an example of a configuration 
of a computer into which a program for executing the 
series of processes described above is installed. 
[0176] The program can be recorded In advance on 
a hard disk 205 or a Read Only Memory (ROM) 203 built 
in the computer and serving as a recording medium. 
[0177] It is otherwise possible to temporarily or per- 
manently store or record the program on a removable 
recording medium 211 such as a flexible disk, a Com- 
pact Disc-Read Only Memory (CD-ROM), an Magneto- 
Optical (MO) disk, a Digital Versatile Disk (DVD), a mag- 
netic disk, or a semiconductor memory. The removable 



recording medium 211 of the type described can be pro- 
vided as package software. 

[0178] It is to be noted that the program may be in- 
stalled by a different method from the method described 
s above wherein the program is installed from such a re- 
movable recording medium 21 1 into the computer as de- 
scribed above. In particular, it Is possible to transfer the 
program from a download site to the computer by wire- 
less communication through an artificial satellite for dig- 
10 ital satellite broadcasting or to transfer the program to 
the computer by wire communication through a network 
such as a Local Area Network (LAN) or the Internet. The 
computer thus can receive the program transferred in 
this manner by means of a communication section 208 
is and install the program Into a hard disk 205 built therein. 
[0179] The computer has a central processing unit 
CPU 202 built therein. An input/output interface 210 is 
connected to the C PU 202 through a bus 201 . If the CPU 
202 receives an instruction when an inputting section 
20 207, which may include a keyboard, a mouse or/and, a 
microphone, is operated by the user through the input/ 
output interface 210, then the CPU 202 executes the 
program stored In the Read Only Memory (ROM) 203. 
Alternatively, the CPU 202 may load a program stored 
25 on the hard disk 205; a program transferred from a sat- 
ellite or a network, received by the communication sec- 
tion 208, and installed in the hard disk 205; or a program 
read out from a removable recording medium 211 load- 
ed in a drive 209 and installed in the hard disk 205 Into 
30 a Random Access Memory (RAM) 204 and executes the 
program loaded In the RAM 204. Thus, the CPU 202 
executes processing in accordance with the flow charts 
described hereinabove or processing to be performed 
by the configuration descrtoed hereinabove with refer- 
35 ence to the block diagrams. Then, the CPU 202, for ex- 
ample, outputs a result of the processing from an out- 
putting section 206, which may include an Liquid Crystal 
Display (LCD) unit or/and a speaker, through the input/ 
output interface 210 as the need arises. Alternatively, 
40 the CPU 202 may transmit the result of the processing 
from the communication section 208 or record the result 
of the processing onto the hard disk 205. 
[0180] In the present specification, the processing 
steps, which describe the program for causing a com- 
45 puter to execute various processes, may be but need 
not necessarily be processed in a time series in the or- 
der as described hereinabove with reference to the flow 
charts. Thus, they may include other processes, which 
are executed parallelly or individually without being 
so processed in a time series such as concurrent process- 
es or processes by objects. 

[0181] Further, the program may be processed by a 
single computer or may otherwise be processed dis- 
cretely by a plurality of computers. Furthermore, the pro- 
55 gram may be transferred to and executed by a remote 
computer. 

[0182] In summary, mutual conversion is performed 
between a file of the standard AV multiplex format in 
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which video data and audio data are placed in a multi- 
plexed state in a body and a file of the AV independent 
format in which video data and audio data are placed 
collectively in respective bodies. Consequently, for ex- 
ample, in order to transmit a file through the network 4 
(for file exchange or streaming), the standard AV multi- 
plex form can be used but in order to record a file onto 
the optical disk 7, the AV independent format can be 
used. 

[0183] Then, where a file of the AV Independent for- 
mat is to be recorded on the optical disk 7, for example I 
AV independent editing (AV split editing) can be per- 
formed readily. 

[0184] Further, in the AV independent format, meta- 
data of frame units are placed collectively in one file 
(metadata file of frame units). Therefore, search tor 
metadata of a frame unit can be performed at a high 
speed. 

[0185] Furthermore, the AV independent format 
adopts the WAVE as a coding system for audio data. 
Therefore, the data amount of audio data can be re- 
duced when compared with that in the case of the stand- 
ard AV multiplex format adopting the AES3. 
[0186] Further, the AV independent format adopts the 
form of a header, a body, and a footer same as that of 
the standard AV multiplex format and besides adopts, 
for the header and the footer, a header and a footer of 
the same form as that of the standard AV multiplex for- 
mat. Consequently, any standard apparatus, which is 
ready for the standard AV multiplex format, can transmit 
and receive a file of the AV independent format and write 
and read out the file onto and from a recording medium. 
[01 87] Furthermore, a file of the standard AV mu Itiplex 
format has a body in which a plurality of essences such 
as video data, audio data, user data, and metadata of 
frame units are placed in a multiplexed state. Mean- 
while, a video file and an audio file in a file of the AV 
independent format have only video data and audio data 
placed in the body, respectively. Accordingly, a file of the 
AV independent format can be considered as a file of 
the MXF whose body includes a single essence. Con- 
tents of a video file or an audio file, which is an MXF file 
wherein a single essence is placed in the body, can be 
read out by any apparatus that can recognize an MXF 
file whose body includes a single essence. 
[0188] It is to be noted that the disk apparatus 1 in the 
present embodiment writes and reads out a file of the 
AV independent format onto and from an optical disk 7. 
However, afile of the AV independent format can be writ- 
ten and read out not only onto and from a recording me- 
dium of the disk type such as the optical disk 7 but also 
onto and from any other recording medium such as a 
recording medium of the tape type such as a magnetic 
tape or a semiconductor memory. 
[0189] Further, in the embodiment of FIG. 1 , the disk 
apparatus 1, which is one apparatus, is composed of 
the disk driving section 11, format conversion section 
12, and communication interface 13. However, each of 



the disk driving section 11, format conversion section 
12, and communication interface 13 may otherwise be 
formed as a single independent apparatus. 
[0190] Furthermore, in the present embodiment, afile 

5 conforming to the MXF is adopted as a file of the stand- 
ard AV multiplex format. However, not only a file, which 
conforms to the MXF, but also any file including a head- 
er, a body, and a footer and having multiplex data of two 
or more arbitrary data placed in the body can be adopted 

10 as a file of the standard AV multiplex format. 

[0191] Further, in the present embodiment, multi- 
plexed data of video data and audio data are placed in 
the body of a file of the standard AV multiplex format. 
However, for example, multiplex data of two or more 

is (streams of) different video data or multiplex data of two 
or more (streams of) different audio data may be placed 
in the body of a file of the standard AV multiplex format. 
[0192] While a preferred embodiment of the present 
invention has been described using specif ic terms, such 

20 description is for illustrative purpose only, and it is to be 
understood that changes and variations may be made 
without departing from the scope of the following claims. 



25 Claims 

1 . A conversion apparatus for converting a file of a for- 
mat including a header, a body, and a footer, com- 
prising: 

30 

conversion means for converting one of a file 
of a f irst format, which includes first and second 
data placed in a multiplexed state in the body, 
and a file of a second format, which includes 
35 first or second data collectively placed in the 

body into the other of the files. 

2. The conversion apparatus according to claim 1, 
wherein said conversion means includes first for- 

40 mat conversion means for converting a file of the 
first format into a file of the second format. 

3. The conversion apparatus according to claim 2, 
wherein the first and second data are video data 

45 and audio data, respectively. 

4. The conversion apparatus according to claim 3, 
wherein said first format conversion means in- 
cludes: 



50 



55 



video data extraction means for extracting the 
video data multiplexed with the audio data in a 
file of the first format; 

video data coupli ng means for coupling the vid- 
eo data extracted by said video data extraction 
means; and 

video header/footer addition means for adding 
a header and a footer of a form same as that of 
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a file of the first format to a body provided by 
the video data coupled by said video data cou- 
pling means to prepare a video file of said video 
data. 

5. The conversion apparatus according to claim 4 S 
wherein said first format conversion means further 
includes file preparation means for preparing a 
master file describing a pointer to the video file. 

5. The conversion apparatus according to claim 3 : 
wherein the audio data in a file of the first format are 
channel-multiplexed audio data formed from audio 
data of a plurality of channels multiplexed with each 
other, and said first format conversion means In- 
cludes: 

audio data extraction means for extracting the 
channel-multiplexed audio data multiplexed 
with the video data in a file of the first file format; 
audio data separation means for separating the 
channel-multiplexed audio data extracted by 
said audio data extraction means into the audio 
data of the individual channels; and 
audio header/footer addition means for adding 
a header and a footer of a form same as that of 
a file of the first format to a body provided by 
the audio data of each of the channels to pre- 
pare audio files of the audio data for the indi- 
vidual channels. 

7. The conversion apparatus according to claim 6, 
wherein the channel-multiplexed audio data in a file 
of the first format are Key, Length, and Value (KLV)- 
encoded data, and said first format conversion 
means includes: 

KLV structure decomposition means for de- 
composing a KLV structure of the KLV-encoded 
channel-multiplexed audio data extracted by 
said audio data extraction means and supply- 
ing resulting audio data to said audio data sep- 
aration means; and 

KLV structuring means for KLV-encoding the 
audio data of the channels obtained by said au- 
dio data separation means so as to individually 
have a KLV structure; 

said audio header/footer addition means add- 
ing a header and a footer to a body provided by 
the audio data of each of the channels struc- 
tured by said KLV structuring means so as to 
have a KLV structure. 

8. The conversion apparatus according to claim 6 : 
wherein the audio data of a file of the first format 
are data encoded by a first coding method, and said 
first format conversion means further includes au- 
dio data conversion means for converting the audio 



9. 



10. 



ts 
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data of the channels coded by the first coding meth- 
od and obtained by said audio data separation 
means into audio data of the channels encoded by 
a second coding method. 

The conversion apparatus according to claim 6, 
wherein said first format conversion means further 
includes file preparation means for preparing a 
master file describing pointers to the audio files of 
the channels. 

The conversion apparatus according to claim 3, 
wherein the body of a file of the first format has 
metadata placed therein in a form multiplexed to- 
gether with the video data and the audio data, and 
said first format conversion means further includes 
metadata file preparation means for preparing a 
metadata file In which the metadata multiplexed In 
the bodies of a file of the first format are collectively 



11. The conversion apparatus according to claim 10, 
wherein said first format conversion means further 
includes file preparation means for preparing a 

25 master file describing a pointer to the metadata file. 

12. The conversion apparatus according to claim 2, fur- 
ther comprising recording means for recording a file 
of the second format obtained by said second for- 

30 mat conversion means onto a recording medium. 

13. The conversion apparatus according to claim 1, 
wherein said conversion means includes second 
format conversion means for converting a file of the 

35 second format into a file of the first format. 

14. The conversion apparatus according to claim 13, 
wherein the first and second data are video data 
and audio data, respectively. 

40 

15. The conversion apparatus according to claim 14, 
wherein a file of the second format includes a video 
file wherein a header and a footer of a form same 
as that of a file of the first format is added to the 

45 body In which the video data are placed collectively, 
and audio files for audio data of a plurality of chan- 
nels in each of which a header and a footer of a form 
same as that of a file of the first format is added to 
the body in which the audio data of the channel are 
placed collectively, and said second format conver- 
sion means includes: 

video header/footer removal means for remov- 
ing the header and the footer from the video file; 
video data decomposition means for decom- 
posing the video data of the video file into video 
data of units to be multiplexed with the audio 
data; 
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audio header/footer removal means for remov- 
ing the headers and the footers from the audio 
files; 

channel multiplexing means for multiplexing 
the audio data of the channels of the audio files 
and outputting resulting channel-multiplexed 
audio data; 

data multiplexing means for multiplexing the 
video data obtained by said video data decom- 
position means and the channel-multiplexed 
audio data obtained by said channel multiplex- 
ing means; and 

header/footer addition means for adding a 
header and a footer of a file of the first format 
to a body provided by the data obtained by said 
data multiplexing means. 

16. The conversion apparatus according to claim 15, 
wherein the audio data of the audio files in a file of 
the second format is KLV-encoded audio data, and 
said second format conversion means further in- 
cludes: 



21 . A conversion apparatus for converting a file of a for- 
mat including a header, a body, and a footer, com- 
prising: 

a converter for converting one of a file of a first 
format, which includes first and second data 
placed In a multiplexed state in the body, and a 
file of a second format, which includes first or 
second data collectively placed in the body into 
the other of the files. 

22. The conversion apparatus according to claim 21 , 
wherein said converter includes a first format con- 
verter for converting a file of the first format into a 
file of the second format. 

23. The conversion apparatus according to claim 22, 
wherein the first and second data are video data 
and audio data, respectively. 

24. The conversion apparatus according to claim 23, 
wherein said first format converter includes: 



KLV structure decomposition means for de- 
composing a KLV structure of the KLV-encoded 
audio data; and 

KLV structuring means for KLV-encoding the 
channel-multiplexed audio data into audio data 
of the KLV structure in a unit to be multiplexed 
with the video data. 

17. The conversion apparatus according to claim 15, 
wherein the audio data in a file of the second format 
are data encoded by a second coding method from 
between first and second coding methods, and said 
second format conversion means further includes 
audio data conversion means for converting the au- 
dio data of the audio files from audio data encoded 
by the second coding method into audio data en- 
coded by the first coding method. 

18. The conversion apparatus according to claim 15, 
wherein a file of the second format further includes 
a metadata file in which the metadata are placed 
collectively, and said data multiplexing means mul- 
tiplexes not only the video data and the channel- 
multiplexed audio data but also the metadata. 

19. The conversion apparatus according to daim 13. 
further comprising transmission means for transmit- 
ting the file of the first format obtained by said sec- 
ond format conversion means through a transmis- 
sion medium. 

20. The conversion apparatus according to claim 1, 
wherein the first format is the Material Exchange 
Format (MXF) . 



a video data extractor for extracting the video 
25 data multiplexed with the audio data in a file of 

the first format; 

a video data couplerfor coupling the video data 
extracted by said video data extractor; and 
a video header/footer adder for adding a head- 
so er and a footer of a form same as that of a file 
of the first format to a body provided by the vid- 
eo data coupled by said video data coupler to 
prepare a video file of said video data. 

35 25. The conversion apparatus according to claim 24, 
wherein said first format converter further includes 
a file preparator for preparing a master file describ- 
ing a pointer to the video file. 

40 26. The conversion apparatus according to claim 23, 
wherein the audio data in a file of the first format are 
channel-multiplexed audio data formed from audio 
data of a plurality of channels multiplexed with each 
other, and said first format converter includes: 

45 

audio data extractor for extracting the channel- 
multiplexed audio data multiplexed with the vid- 
eo data in a file of the first file format; 
an audio data separator for separating the 

50 channel-multiplexed audio data extracted by 

said audio data extractor into the audio data of 
the individual channels; and 
an audio header/footer adder for adding a 
header and a footer of a form same as that of 

55 a file of the first format to a body provided by 

the audio data of each of the channels to pre- 
pare audio files of the audio data for the indi- 
vidual channels. 
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27. The conversion apparatus according to claim 26. 
wherein the channel-multiplexed audio data in a file 
of the first format are KLV-encoded data, and said 
first format converter includes: 

a KLV structure decomposer for decomposing 
a KLV structure of the KLV-encoded channel- 
multiplexed audio data extracted by said audio 
data extractor and supplying resulting audio da- 
ta to said audio data separator; and 
a KLV structurerfor KLV-encodingthe audio da- 
ta of the channels obtained by said audio data 
separator so as to individually have a KLV 
structure; 

said audio header/footer adder adding a head- 
er and a footer to a body provided by the audio 
data of each of the channels structured by said 
KLV structurer so as to have a KLV structure. 

28. The conversion apparatus according to claim 26. 
wherein the audio data of a file of the first format 
are data encoded by a first coding method, and said 
first format converter further includes an audio data 
converter for converting the audio data of the chan- 
nels coded by the first coding method and obtained 
by said audio data separator into audio data of the 
channels encoded by a second coding method. 

29. The conversion apparatus according to claim 26. 
wherein said first format converter further includes 
file preparatorfor preparing a master file describing 
pointers to the audio files of the channels. 

30. The conversion apparatus according to claim 23, 
wherein the body of a file of the first format has 
metadata placed therein in a form multiplexed to- 
gether with the video data and the audio data, and 
said first format converter further includes metadata 
file preparatorfor preparing a metadata file in which 
the metadata multiplexed in the bodies of a file of 
the first format are collectively placed. 

31. The conversion apparatus according to claim 30 : 
wherein said first format converter further includes 
file preparatorfor preparing a master file describing 
a pointer to the metadata file. 

32. The conversion apparatus according to claim 22. 
further comprising a recorder for recording a file of 
the second format obtained by said second format 
converter onto a recording medium. 

33. The conversion apparatus according to claim 21, 
wherein said converter includes a second format 
converter for converting a file of the second format 
into a file of the first format. 

34. The conversion apparatus according to claim 33, 



34 

wherein the first and second data are video data 
and audio data, respectively. 

35. The conversion apparatus according to claim 34, 
5 wherein a file of the second format includes a video 

file wherein a header and a footer of a form same 
as that of a file of the first format is added to the 
body in which the video data are placed collectively, 
and audio files for audio data of a plurality of chan- 
io nels In each of which a header and a footer of a form 
same as that of a file of the first format is added to 
the body in which the audio data of the channel are 
placed collectively, and said second format convert- 
er includes: 

15 

a video header/footer remover for removing the 
header and the footer from the video file; 
a video data decomposer for decomposing the 
video data of the video file into video data of 

20 units to be multiplexed with the audio data; 

an audio header/footer remover for removing 
the headers and the footers from the audio files; 
a channel multiplexer for multiplexing the audio 
data of the channels of the audio files and out- 

25 putting resulting channel-multiplexed audio da- 

ta; 

a data multiplexer for multiplexing the video da- 
ta obtained by said video data decomposer and 
the channel-multiplexed audio data obtained by 
00 said channel multiplexer; and 

a header/footer adder for adding a header and 
a footer of a file of the first format to a body pro- 
vided by the data obtained by said data multi- 
plexer. 

35 

36. The conversion apparatus according to claim 35, 
wherein the audio data of the audio files in a file of 
the second format is KLV-encoded audio data, and 
said second format converter further includes: 

40 

a KLV structure decomposer for decomposing 
a KLV structure of the KLV-encoded audio data; 
and 

a KLV structurer for KLV-encoding the channel- 
45 multiplexed audio data into audio data of the 

KLV structure in a unit to be multiplexed with 
the video data. 

37. The conversion apparatus according to claim 35, 
50 wherein the audio data in a file of the second format 

are data encoded by a second coding method from 
between first and second coding methods, and said 
second format converter further includes an audio 
data converter for converting the audio data of the 
55 audio files from audio data encoded by the second 
coding method into audio data encoded by the first 
coding method. 
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38. The conversion apparatus according to daim 35, 
wherein a file ot the second format further Includes 
a metadata file in which the metadata are placed 
collectively, and said data multiplexer multiplexes 
not only the video data and the channel-multiplexed 
audio data but also the metadata. 

39. The conversion apparatus according to claim 33, 
further comprising a transmitter for transmitting the 
file of the first format obtained by said second format 
converter through a transmission medium. 

40. The conversion apparatus according to daim 21 , 
wherein the first format is the MXF. 

41 . A conversion method for converting a file of a f onmat 
including a header, a body, and a footer, comprising 
the steps of: 

receiving one of a file of a first format wherein 
first and second data are placed in a multi- 
plexed state in the body and a file of a second 
format wherein first or second data are placed 
collectively in the body; and 
converting one of the file of the first format and 
the file of the second format into the other of 
the files. 

42. The conversion method according to claim 41, 
wherein the conversion step includes a first format 
conversion step of converting a file of the first format 
into a file of the second format. 

43. The conversion method according to claim 42, 
wherein the first and second data are video data 
and audio data, respectively. 

44. The conversion method according to claim 43. 
wherein the first format conversion step includes: 

a video data extraction step of extracting the 
video data multiplexed with the audio data in a 
file of the first format; 

a video data coupling step of coupling the video 
data extracted by the video data extraction 
step; and 

a video header/footer addition step of adding a 
header and a footer of a form same as that of 
a file of the first format to a body provided by 
the video data coupled by the video data cou- 
pling step to prepare a video file of said video 
data. 

45. The conversion method according to claim 44, 
wherein the first format conversion step further in- 
cludes a file preparation step of preparing a master 
file describing a pointer to the video file. 



46. The conversion method according to daim 43, 
wherein the audio data in a file of the first format are 
channel-multiplexed audio data formed from audio 
data of a plurality of channels multiplexed with each 

5 other, and the first format conversion step includes: 

an audio data extraction step of extracting the 
channel-multiplexed audio data multiplexed 
with the video data in a file of the first file format; 

10 an audio data separation step of separating the 

channel-multiplexed audio data extracted by 
the audio data extraction step into the audio da- 
ta of the individual channels; and 
an audio header/footer addition step of adding 

'5 a header and a footer of a form same as that of 

a file of the first format to a body provided by 
the audio data of each of the channels to pre- 
pare audio files of the audio data for the indi- 
vidual channels. 

20 

47. The conversion method according to claim 46, 
wherein the channel-multiplexed audio data in a file 
of the first format are KLV-encoded data, and the 
first format conversion step includes: 

25 

a KLV structure decomposition step of decom- 
posing a KLV structure of the KLV-encoded 
channel-multiplexed audio data extracted by 
the audio data extraction step and supplying re- 
30 suiting audio data to the audio data separation 

step; and 

a KLV structuring step of KLV-encoding the au- 
dio data of the channels obtained by the audio 
data separation step so as to individually have 

35 a KLV structure; 

the audio header/footer addition step adding a 
header and a footer to a body provided by the 
audio data of each of the channels structured 
by the KLV structuring step so as to have a KLV 

40 structure. 

48. The conversion method according to claim 46, 
wherein the audio data of a file of the first format 
are data encoded by a first coding method, and the 

45 first format conversion step further includes an au- 
dio data conversion step of converting the audio da- 
ta of the channels coded by the first coding method 
and obtained by the audio data separation step into 
audio data of the channels encoded by a second 

so coding method. 

49. The conversion method according to claim 46, 
wherein the first format conversion step further in- 
cludes a file preparation step of preparing a master 

55 file describing pointers to the audio files of the chan- 
nels. 

50. The conversion method according to claim 43, 
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38 



wherein the body of a file of the first format has 
metadata placed therein In a form multiplexed to- 
gether with the video data and the audio data, and 
the first format conversion step further includes a 
metadata file preparation step of preparing a meta- 
data file in which the metadata multiplexed in the 
bodies of a file of the first format are collectively 
placed. 

51. The conversion method according to claim 50, 
wherein the first format conversion step further in- 
cludes a file preparation step of preparing a master 
file describing a pointer to the metadata file. 

52. The conversion method according to claim 42, fur- 
ther comprising a recording step of recording a file 
of the second format obtained by the second format 
conversion step onto a recording medium. 

53. The conversion method according to claim 41, 
wherein the conversion step includes a second for- 
mat conversion step of converting a file of the sec- 
ond format into a file of the first format. 

54. The conversion method according to claim 53. 
wherein the first and second data are video data 
and audio data, respectively. 

55. The conversion method according to claim 54 t 
wherein a file of the second format includes a video 
file wherein a header and a footer of a form same 
as that of a file of the first format is added to the 
body in which the video data are placed collectively 
and audio files for audio data of a plurality of chan- 
nels in each of which a header and a footer of a form 
same as that of a file of the first format is added to 
the body in which the audio data of the channel are 
placed collectively, and the second format conver- 
sion step includes: 

a video header/footer removal step of removing 
the header and the footer from the video file; 
a video data decomposition step of decompos- 
ing the video data of the video file into video 
data of units to be multiplexed with the audio 
data; 

an audio header/footer removal step of remov- 
ing the headers and the footers from the audio 
files; 

a channel multiplexing step of multiplexing the 
audio data of the channels of the audio files and 
outputting resulting channel-multiplexed audio 
data; 

a data multiplexing step of multiplexing the vid- 
eo data obtained by the video data decompo- 
sition step and the channel-multiplexed audio 
data obtained by the channel multiplexing step; 
and 



a header/footer addition step of adding a head- 
er and a footer of a file of the first format to a 
body provided by the data obtained by the data 
multiplexing step. 

5 

56. The conversion method according to claim 55, 
wherein the audio data of the audio files in a file of 
the second format is KLV-encoded audio data, and 
the second f ormat conversion step further includes: 

w 

a KLV structure decomposition step of decom- 
posing a KLV structure of the KLV-encoded au- 
dio data; and 

a KLV structuring step of KLV-encoding the 
15 channel-multiplexed audio data into audio data 

of the KLV structure in a unit to be multiplexed 
with the video data. * 

57. The conversion method according to claim 55, 
20 wherein the audio data in a file of the second format 

are data encoded by a second coding method from 
between first and second coding methods, and the 
second format conversion step further includes an 
audio data conversion step of converting the audio 
25 data of the audio files from audio data encoded by 
the second coding method into audio data encoded 
by the first coding method. 

58. The conversion method according to claim 55, 
30 wherein a file of the second format further includes 

a metadata file in which the metadata are placed 
collectively, and the data multiplexing step multi- 
plexes not only the video data and the channel-mul- 
tiplexed audio data but also the metadata. 



35 

59. The conversion method according to claim 53, fur- 
ther comprising a transmission step of transmitting 
the file of the first format obtained by the second 
format conversion step through a transmission me- 

40 dium. 

60. The conversion method according to claim 41, 
wherein the first format is the MXF. 

45 61. A program for causing a computer to execute a con- 
version method for converting a file of a format in- 
cluding a header, a body, and a footer, said program 
comprising: 

so a conversion step of converting one of a file of 

a first format, which includes first and second 
data placed in a multiplexed state in the body, 
and a file of a second format, which includes 
first or second data collectively placed in the 

55 body, into the other of the files. 

62. A data structure of a file of a format including a 
header, a body, and a footer, comprising: 



20 



EP1 427 217 A1 




23 




24 



BP 1 427 217 A1 



O 

< 

X 
OLU 

CXZ I 

<Q- 
O — 



COS 



C5 CM 



CM 



CC 
O 

>Ll- 

< 

X 
OLU 
CC — I 

Zh 

<_J 

COS 
A 











\UJO 


OQ — 


trzcoz 




Of o 


DO. 


LU — 




>H- 


<QZO 


HZOliJ 


CO — 


O00 



CM , 
CM 



UJ O 

LLKQTO 
O.QUJ- 
UJZ>K 

o<zo 

ZHOIil 

— GOO CO 



Y 

I— 
< 

o 



o 



LU 
O 



LU 
O 



LU 
O 
Z 
LU 
Q. 
LU 
O 



> 
< 



25 



EP 1 427 217 A1 




in 
(3 



CO"" 



U-O 

Q<C — 
<CLI- 
I— LUO 

luce: lu 

SO. CO 



CO 



^2 

«2 

— oro 

— CXh- 
XLUO 
ZD OlL LU 
«£Q-CO 



LU O 



LUQ_|— 

onto 

— CXI LU 
>CUOO 



co_ 
ti- 



ll. «cz 
ceo 
o<c — 

— Q-.I— 
OLUO 

<CCl-CO 



in 

CO' 



2 

LUO 

s — 

crroo 
lu — 

LUX UJ 

□C LU CO 



CM 

CO" 



—J o 



oroco 
lu <c — 

I — Q_ f — 
CO LUO 
-< CCLU 
SO- CO 



CO 



to 

CO 



U-IC7 



SCO o 
LULU — 
I— C_> F— 
COOO 
>- CCLU 
CO Q_ CO 





EM 








»— 




LU 


co 

CO^ 


XILIARY I 

TRACTION 

CTION 




ICTURE IT 
XTRACTION 
ECTION 




DXUJ 




n. lu co 




■< LUC/5 





LU OLU 
3I-<CO 



co- 



cm 



LUO 

!z 

o 



3° 



»— o 

XLU 
LUGO 



COO 
>DI- 

CO<CcO 



CO' 



X 

O LU 

or __i 

2 ^£ 

h->DO 
CO<SLL 



26 



EP 1 427 217 A1 



LU 
-J 

Li. 

O 
LU 
O 

> 



CD 

CD 



CvJ 
LTV 



DC)— 
LUO 
»-LJJ 
OGO 
O 

U-2 

\o 

C£ — 
LUI— 
Q — 
<Q 
LUO 



CD 

— O 
-J — 
CLI— 



LU 



o 
a. 



27 



EP 1 427 217 A1 



O 

— LU 
O— J 
ID — 



6 



h-20 
<OUJ 
OOCO 



CO I 



CVJ 



a. 

—J — 2 
LUh-O 
2—1 — 

<SO 
21 LULU 
OOCO 



>8 

— ILU 



2S 
ZDUJ 
OK 

CO — 



28 



EP 1 427 217 A1 



F I G. 8 



(master file preparation process) 



( END ) 

F I G. 9 







PRODUCE FILE NAMES OF METADATA 
FILES. AUXILIARY FILE, VIDEO FILE. 
AND AUDIO FILES 






PREPARE MASTER FILE IN WHICH 
LINKS OF FILE NAMES TO FILES 
ARE DESCRIBED IN XML 







—SI 



~S2 



(METADATA F 
(METADATA ! 
FOR FILE Ul 



ILE PREPARATION PROCESS 
FILE PREPARATION PROCESS 
UNITS) 







ACQUIRE HEADER 






EXTRACt HEADER METADATA PLACED _ 
IN HEADER 






PREPARE METADATA FILE OF FILE UNITS 
IN WHICH HEADER METADATA ARE PLACED 







-S11 



~S12 



-S13 



( END ) 



29 



EP 1 427 217 A1 



FIG.10 



c 



METADATA FILE PREPARATION PROCESS 
(METADATA FILE PREPARATION PROCESS 
FOR FR AME UNITS) 

I 



ACQUIRE BODY 



I 



~S21 



EXTRACT SYSTEM 



ITEMS 



—S22 



COUPLE ALL SYSTEM ITEMS TO 
PREPARE METADATA FILE OF 
FRAME UNITS 



-S23 



(end) 



F I G. 1 1 



( AUXILIARY FILE PREPARATION PROCESS ) 



V 








ACQUIRE BODY 


-S31 


* 








EXTRACT AUXILIARY I 


TEMS 


-S32 










COUPLE ALL AUXILIARY 
TO PREPARE AUXILIARY 


ITEMS 
FILE 


~S33 



( END ) 



30 



EP1 427 217 A1 



F I G. 1 2 



( VIDEO FILE PREPARATION PROCESS ) 

— Y 

~~ ' S41 



ACQUIRE BODY 

i 



EXTRACT PICTURE ITEMS 

i 



COUPLE ALL PICTURE ITEMS 



~S43 



ADD HEADER AND FOOTER TO 
COUPLED PICTURE ITEMS TO 
PREPARE VIDEO FILE 

I 



~S44 



(JND_) 



31 



EP 1 427 217 A1 



FIG. 13 

C AUDIO FILE PREPARATION PROCESS ) 

^ ' 



ACQUIRE BODIES h s51 

S52 



EXTRACT SOUND ITEMS 
I 



DECOMPOSE KLV STRUCTURE 



-S53 



SEPARATE INTO AUDIO DATA FOR 
INDIVIDUAL CHANNELS 



-S54 



CONVERT AUDIO DATA OF INDIVIDUAI S55 

CHANNELS 



I 



CONVERT AUDIO DATA OF EACH CHANNEL _cefi 
SO AS TO HAVE KLV STRUCTURE ^ >0 



ADD HEADER AND FOOTER TO AUDIO 
DATA OF INDIVIDUAL CHANNELS TO 
PREPARE AUDIO FILES 

( END J 



-S57 



32 



EP 1 427 217 A1 



00 






LU 
— 1 










CO 


■< — 








<coo 




OUJ — 




<OK 




I— oo 




LU CEL LU 









LE 












LU <JD 








JZ 




o 








>-z 


in 


UlWZ 




cc — 


COO 




<COZ 


OUJ — 




— co o 


UJOh 




1 LU — 




o oo 








— OTLU 




x o o 




^> Q_ OO 




OQTLU 








<<CL>CO 






t 




t 



CO 



LU CI? 



U-W2 
CO o 
OUJ — 
— Oh 

ooo 

rDCCLU 
<CQ-CO 



CM 




>zo 



33 



EP1 427 217 A1 



UJ 

a: 



CNJ 



o 

LU 
O 



34 



EP1 427 217 A1 



oco 

Oh- 

co- 



in 

cm — j 



LU 

o 



CD 
C5 



CM- 



CD 



X 

uu 

JJ2 
JO.O 



<JO 
m ZD LU 



CO 

cnj^H 



W2 

ceo 

LU — 
<C>h- 

<OLU 

ooco 



o 



CM 
CM — 



LU 

a 



CM- 



o 
a: — 

LUh- 

H-O 
OLU 
O GO 



LU> 
OO 
<2E 
LULU 

la: 



T 

o 

— LU 

§=^ 



35 



# 



EP 1 427 217 A1 



C3 
Li_ 



CO- 




QCOO 

ujcruj 

XQ.W 



oco 
I— 
< — 
\ — 

<Z> 

<LU 
h-_J 
UJ — 
Sit 



CO 


CO 


CO 


CO 




s 


s 






LU 


LU 


LU 




h- 


h— 


h- 




>- 


LU 


Q 


LU 




Od 




1- 


< 


ZD 


Z> 


00 




\- 


o 






O 


oo 


GO 










>c 


0l 














< 







36 



EP 1 427 217 A1 



F I G. 1 8 



( METADATA FILE PROCESS ) 



ACQUIRE METADATA FILE OF FILE UNITS 
AND METADATA FILE OF FRAME UNITS 



I 



-S101 



ACQUIRE METADATA OF FILE UNITS 
AND SYSTEM ITEM 



" 3 



— S102 



FIG. 19 



( AUX I L I ARY F I LE PROCESS ^ 



ACQUIRE AUXILIARY FILE 



I 



-stn 



DECOMPOSE INTO AUXILIARY ITEMS —S1 12 



( END ) 



37 



EP 1 427 217 A1 



F I G. 2 0 



C~ VIDEO FILE PROCESS J 

7 



ACQUIRE VIDEO FILE 

I 



-S121 



REMOVE HEADER AND FOOTER (-S122 



DECOMPOSE INTO PICTURE 
ITEMS 

T 



-S123 



C END ) 



38 



EP1 427 217 A1 



F I G. 2 1 



c 



AUDIO FILE PROCESS 



I 



ACQUIRE AUDIO FILE 
i ~ 



REMOVE HEADER AND FOOTER 
I 



DECOMPOSE KLV STRUCTURE 



-S131 



-S132 



-S133 



CONVERT AUDIO DATA OF CHANNELS 

E 



-S134 



MULTIPLEX AUDIO DATA OF CHANNELS 

I 



-S135 



CONVERT AUDIO DATA OF FRAMES 
SO AS TO HAVE KLV STRUCTURE 



I 



COMPOSE SOUND ITEMS 



hS136 
S137 



(JENCT) 



39 



# 



EP 1 427 217 A1 



F I G. 2 2 



c 



SYNTHESIS PROCESS 



J 



PRODUCE HEADER AND FOOTER 



I 



— S141 



MULTIPLEX SYSTEM ITEMS. AUXILIARY 
ITEMS. VIDEO ITEMS. AND SOUND ITEMS 

I 



— S142 



ADD HEADER AND FOOTER 
C END j 



-S143 



40 



EP 1 427 217 A1 



LO 

CD- 
CM 













CO 




o 




o 


^ jr 3 


en 




< 




DC 





CO 
CM 

d 

Ll 



o- 

CNJ 



< 



CO 



O 





eg 


ZD 




CD- 






CM 


O 


*> 







\ 



\ 



o 



< 

LU 



ZD 

o 



lucd 

JZ 
00 — 

<os 
oo — 

SOQ 
U-ILULU 



CM 



LU 



< 

a 

— z 

20 
3 — 
SK 
SO 
OLU 
O00 



O 
ZZL 
— 

I— O 

I 

IDJ— 
Q-O 
ZLU 
— CO 



o 



l-O 
3 — 

K-O 
3LU 



-CD 
CM 



CO 
CM 



CM 



CD 
CM 



41 



; 



EP 1 427 217 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



AppflcaUon Number 

EP 63 25 5670 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



(Station of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION {tnLO.7) 



AL KOVALICK: "Material Exchange Format 
FAQ* 

PINNACLE SYSTEMS, 

20 May 2002 (2802-05-20), pages 1-4, 
XPG02276055 

Retrieved from the Internet: 

URL: http://www.pi nnaclesys.com/BSD/nrediast 

ream900fornetworkedstorage/Engl i sh(US)/doc 

/MXF%20faq%20in%20wp%2Ofonnat%2O5%2002.pdf 

> 

* paragraph [60Q7] * 



WO 02/21845 A (SONY UK LTD 

OAMES HEDLEY (6B)) 

14 March 2002 (2002-03-14) 



WILKINSON 



* abstract * 

* page 2, line 1 - line 32 * 

* page 4, line 20 - page 7, line 29 

* page 15, line 6 - line 31 * 

* page 17, line 5 - line 17 * 

* page 17, line 24 - line 26 * 

* page 18, line 4 - line 15 * 

* figures 1-4,7,10-14 * 

-/~ 



The present search report has been drawn up for a» claims 



1-3,10, 
12-14, 
19-23, 
30. 

32-34, 
39-43, 
50, 

52-54, 
59-61 



4,6,7 
10 . 

12-16, 
18-24, 
26,27, 
30, 

32-36, 
38-44. 
46.47, 
50, 

52-56, 
58-60 



H04N7/52 
H04N7/24 



TECHNICAL FIELDS 
SEARCHED (rnl.CI.7) 



H04N 

G06F 



The Hague 



Oate Of comptotcn of rhe ceafCh 

5 April 2004 



Beaudet, J-P 



CATEGORY OF CITED DOCUMENTS 

X : partioulariy relevant if taken done 

Y : particularly relevant a combined wflh another 

document of the tame oetesofy 
A : taohnobgica) background 
O : non-written daotoeure 
P i intermediate document 



T : theory or principle urtdertyfag the invention 
E : earner patent document, but pubfehed on, or 

after the Hng date 
D : document oited In the oppt'cstton 
L : document cited tor other reeaone 

ft : member of the earno patent family, corresponding 



42 



# 



EP 1 427 217 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 03 25 5670 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with ind cation, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION prd.CI.7) 



GB 2 371 889 A (SONY UK LTD) 
7 August 2082 (2882-88-07) 



* abstract * 

* page 1, line 8 - line 25 * 

* page 2, line 3 - line 11 * 

* page 6, line 20 - page 7, line 4 * 

* page 16, line 19 - page 17, line 3 * 

* figures 1,7 * 

HANS HOFFMANN: "File Exchange formats for 

Networked television production 0 

EBU TECHNICAL DEPARMENT, 

July 2082 (2002-07), pages 1-8, 

XP002276656 

Retrieved from the Internet: 

URL : http : //www . ebu . ch/ 1 re v_29 1 - hof f mann . pd 

f> 



* the whole document * 



-/-- 



The present search report has been drawn up tor all claims 



1-4,6,7, 
10. 

12-16, 
18-24, 
26,27. 
30, 

32-36. 
38-44, 
46,47, 
50, 

52-56, 
58-60 



1-3,7, 
10. 

12-14, 
16, 

18-23, 
27,30, 
32-34, 
36, 

38-43, 
47,50, 
52-54, 
56,58-6G 



TECHNICAL FIELDS 
SEARCHED (lntCL7) 



FTaeo d searcl) 

The Hague 



Dais oi nonaction of tho t c . uch 

5 April 2004 



Beaudet, J-P 



CATEGORY OF CITED DOCUMENTS 

X : parti cu tarty relevant V talon mtono 

Y : pert} cu tarty relevant if combined with another 

document of the tame category 
A : technobgtaal background 
O : non-written disclosure 
P : Intermediate dooument 



T : theory or prtncfrie underlying the invention 
E : eerier patent document, but publfahed on, or 

after the Ring date 
D : dooument cited in the application 
I : document dtad for other reasons 



a : member of the same patent family, corresponding 



43 



EP 1 427 217 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 63 25 567© 



Category 



DOCUMENTS CONSIDERED TO BE RELEVANT 



BRUCE DEVLIN: "MXF - the Material 
exchange Format" 

EBU TECHNICAL REVIEW, July 2002 (2002-07), 

pages 1-7, XP882276057 

Retrieved from the Internet: 

URL : http : //www . ebu . ch/trev_291-devl i n . pdf > 



Citation cl document with indication, where appropriate, 
, of relevant passages 



* the whole document 



The present search report has been drawn up tor all claims 



1-3,7, 
10,13, 
14,16, 
18, 

20-23, 
27,30, 
33,34, 
36,38, 
40-43, 
47,50, 
53,54, 
56,58, 6C 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (rntCt7) 



TECHNICAL FIELDS 

Ont.a.7) 



place of save* 


Dtfta o< carf*etkn c* th. wench 




The Hague 


5 April 2004 


Beaudet, J-P 


CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken aionm 

Y : particularly relevant * oombinad with and 

document of th» Mine category 
A : teormologfeal background 
O : non-written dbcJosure 
P '. Intermodule document 


T ; theory or princ*4* underling the invention • 
E : earlier patent document, but pubBahed on, or 
•tor the nlno date 
nor O : document ottod tofts oppfiocbon 
L : ctocement e»ed for other reason* 


a : member of the wmt potent family, oonBtponAjj 
document 



44 



EP 1 427 217 A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 03 25 5670 



This annex lists the patent family members relating to the ^terf£wments cited in the aoove^mentioned European search report. 
T^n^timani as contained in the European Patent Office EDP die on . 
SSr^XSt^^ B^eforlhese particulars which are mere* given for the purpose of mfonnabon. 

05-04-2004 



Patent document 
cited vi search report 



WO 0221845 



Publication 
date 

14-03-2002 



Patent f amity 
member(s) 



Publication 



GB 
EP 
WO 
US 



2366926 A 
1316217 Al 
0221845 Al 
2002164149 Al 



20-03-2002 
04-06-2003 
14-03-2002 
07-11-2002 



GB 23718B9 A 07-08-2002 NOME 



§ For more details about this annex : see Official Journal of the European Patent Office, No. 1 2/B2 



45 



